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ABSTRACT 
Classifying traffic signs is an indispensable task for autonomous driving systems. Depending on the country, 
traffic signs possess a wide variability in their visual appearance making it harder for classification systems to 
succeed. Either the classifier should be fine-tuned or a bigger collection of images should be used. Nowadays, 
Intelligent Autonomous Vehicles together with Advanced Driver Assistance Systems (ADAS) deal with the 
problem of traffic sign recognition. It is a challenging real world computer vision problem due to the different 
and complex scenarios they are placed into. After images are classified they are made into the groups like 


highway signs, speed signs, danger signs etc. 


Keywords — Self-Driving Car, traffic sign, recognition and detection, HOG and SVM, MSER and HSV. 


I. INTRODUCTION 


Traffic sign detection and recognition (TSDR) 
system has been introduced to reduce traffic safety 
concerns. A TSDR system detects and recognizes 
traffic signs from and within images captured by 
cameras or imaging sensors displaying to the user the 
user what traffic rules are applicable at that stretch of 
road. In bad traffic conditions, the driver may not 
notice traffic signs, due to which accidents occur. In 
such cases, the TSDR system comes into play. The 
main objective of the research on TSDR is to improve 


the efficiency and working speed of the TSDR system. 


To develop a TSDR system is a difficult job given the 
continuous changes in the environment and lighting 
conditions. There are other issues such as partial 
obscuring, multiple traffic signs appearing at the same 
time, and blurring and fading of old traffic signs, 
which can also create problem for the detection 
purpose and need to be addressed. For application of 
TSDR system in real-time environment such as self- 
driving cars, a quick algorithm is required. Also 
dealing with issues, a recognition system should 
avoid errors in recognition of non-signs. 


II. PROBLEM DEFINITION 


Classifying traffic signs is a very important task for 
autonomous driving systems as the safety of everyone 
as well as the passenger depends on it. Depending on 
the country, traffic signs possess a variety in their 
visual appearance making it harder for classification 
systems to succeed. 

Nowadays, Intelligent Autonomous Vehicles 
together with Advanced Driver Assistance Systems 


(ADAS) deal with the problem of traffic sign 
recognition. It is a challenging real world computer 


vision problem due to the different and complex 
scenarios they are placed into. The proposed system 
will help understand the problem and provide a 
systematic way of approaching the problem. 


HI. AIMS & OBJECTIVES 


All Through this project we aim to make a system 
which can be used universally for traffic signs and 
symbols, which in turn would help us learn more 
about deep learning. The objectives of the system is 
first to detect and then classify signs. To detect, a 
combination of MSER and HSV is used. This works 
well when we have lots of images as well as not clear 
ones. For classification HOG is used, along with 
SVM Classifier. Now this working in conjunction 
make the results more accurate and we get a model 
with high accuracy. 


IV. SCOPE 


The traffic signs focus on reducing traffic and 
increasing safety of the road network through various 
travel management measures, speed limits etc. Traffic 
signs should remove the encroachments, congestion 
and improve the traffic signal, road condition and 
geometrics features at intersections. The traffic signs 
should be as a guidance or speaker on a road network. 
Traffic sign reduce the traffic congestion along the 
road and also provide facilities for the road users. 
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Road signs tell users of the various regulations when 
using the road as well as providing guidance and 
when needed also warnings for safe, efficient 
operation. The purpose of road signs is to promote 
road safety and effective use of roads by both 
pedestrians and traffic. 


V. LITERATURE SURVEY 


The first research on traffic sign recognition was 
back in 1987; Akatsuka and Imai tried to make a very 
basic traffic sign recognition system. A system 
capable of by itself recognize of traffic sign and used 
as an assistance for drivers, telling them about the 
presence of some specific restriction or danger in 
speeding or construction work. It can be used to 
provide the automatic recognition for specific traffic 
signs. Generally, the procedure of a traffic sign 
recognition system is divided into two parts, detection 
and classification. 


A. Detection 


The aim in using traffic sign detection is to locate 
the regions of interest (ROD in which a traffic sign 1s 
likely to be found. Cropping the excess space is 
what’s required to get the main sign. This technique 
called as ROI. ROI locates the traffic sign in based on 
its shape dimensions etc. The traffic signs are cropped 
which is useful. The background image is removed as 
it is not an area of interest. By this we assume, that a 
large part of the image area can be ignored as not 
required. Traffic signs are designed with set color and 
shape making them easier to differentiate and 
recognize. 


B. Classification 


In this part the sign is classified based on the type 
shape colour and the information the sign is giving. 
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Histogram of oriented gradients (HOG) Features: 
HOG decomposes an image into small squared cells, 
computes a histogram of oriented gradients in each 
cell, normalizes the result using a block-wise pattern, 
and return a descriptor for each cell 


Input image 


Histogram of Oriented Gradients 





Fig. 1 A sample of HOG 


We can also use UNet for classification with an 
encoder decoder architecture. In this the image 1s 
given through various layers and then the output is 
also put through layers before final output is given. 
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Fig. 2 UNet Architecture 


www.trendytechjournals.com 


24 


JTRET 


"Voice of Innovative Minds” 


International Journal of Trendy Research in Engineering and Technology 


VI. PROPOSED SYSTEM 


Through this project we aim to make a system 
which can be used universally for traffic signs and 
symbols, which in turn would help us learn more 
about deep learning. The objectives of the system is 
first to detect and then classify signs. To detect, 
localization U-Net, a convolutional neural network 
with an encoder-decoder architecture, is used. We can 
also use image preprocessing techniques such as 
median filter to clean salt and pepper noise in image, 
then contrast normalization over each channel. For 
classification SqueezNet can be used but for greater 
accuracy we can also use HOG classifier. Since this 
is a survey paper we are still looking out for the better 
method from the above proposed systems to get the 
best accuracy and result. 


»| Apply Processing 
Algorithms 


Preprocess 
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Classify Sign (if p| Highlight Images 
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Fig. 3 Block Diagram 


VII. CONCLUSION 


From doing this project we plan to understand the 
science behind auto recognition of traffic signs 
helping autonomous cars and drivers to be safer when 
driving on the roads. We also get to learn the various 
aspects of image processing and computer vision used 
algorithms to get desired output. We plan to future 
study this topic and prepare a full working traffic sign 
detection and recognition system. 
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